| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |
Gustavo Diaz
McMaster University
gustavodiaz.org
diazg2@mcmaster.ca
Slides: talks.gustavodiaz.org
“Future research should confirm if our findings generalize…”
Consider resource/ethical/practical limitations
Conduct survey experiment with convenience sample
Wave hands about external validity
Move beyond limitations approach
Should we ever implement an externally invalid survey experiment on purpose?
Identify what makes external invalidity desirable
Challenge: Different kinds of external (in)validity
| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |
| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |
| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |
| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |
| Type | Concern |
|---|---|
| Sample | Does this apply to a different population? |
| Treatments | Do they resemble real-world phenomena? |
| Outcomes | Do they reflect actual behaviors? |
| Contexts | Does this apply in a different setting? |